KMID : 1138720220480040067
|
|
Korean Public Health Research 2022 Volume.48 No. 4 p.67 ~ p.78
|
|
Concordance for job codes which three raters chose based on the information collected by open-ended questionnaire
|
|
Park Moon-Young
Yoon Hyung-Kee Oh Se-Eun Kim Sol-Hwee Hong Ki-Myong Park Seok-Hwan Lee Eun-Sun Lee Kyoung-Mu
|
|
Abstract
|
|
|
Background: Information on occupation is known as one of the important information sources for socioeconomic and epidemiological research. It can be used to assume socioeconomic status and level of physical activity, to forecast the likelihood of a work-related accident or disease, and to assess the existence and degree of exposure to various risk factors in workplace.
Objective: Individual information on occupation is often collected by open-ended questions and then coded into job categories by researchers according to the standard job classification systems. This study aims to assess the reliability among the job codes that three raters independently classified using the information on occupation collected by open-ended questionnaire.
Methods: Information on occupation was collected from two surveys with different populations (145 health examinees and 154 college students of open university) with open-ended questionnaire. Two surveys were basically self-administered, but the health examinee survey questionnaire was checked by a trained interviewer. Two occupational classification systems, i.e., the Korean Standard Classification of Occupational (KSCO, 14 categories) and the Korean Standard Industrial Classification (KSIC, 21 categories) were used for job-coding by three junior researchers in the field of public health, The degree of agreement/concordance was assessed by Cohen¡¯s Kappa or Fleiss Kappa and 95% confidence interval (CI).
Results: Concordance of job codes among three raters for KSCO was moderate for health examinees (k=0.56, 95% CI=0.52-0.58) and fair for open university students (k=0.34, 95% CI=0.31-0.38). That of KSIC was moderate for both health examinees (k=0.60, 95% CI=0.57-0.63) and open university students (k=0.46, 95% CI=0.43-0.49). There was observed a lot of variation in category-specific kappa values for both KSCO and KSIC classification.
Conclusion: Increased concordance of job coding is expected when interview survey is used to collect open-ended questions for the information on occupation and then definite protocol for classification is adopted or to conduct prior education before coding.
|
|
KEYWORD
|
|
concordance, kappa statistics, occupational classification, Korean Standard Classification of Occupations, Korean Standard Industrial Classification
|
|
FullTexts / Linksout information
|
|
|
|
Listed journal information
|
|
|
|